Food is not cheap in New Caledonia, but you can do well shopping at the non-tourist shops. Learn to detect the boulangerie and patisserie for bread and pastries, the charcuterie for meat and pâté and so on, but don't pass by the slightly seedy-looking general stores, where you can probably get tinned pâté, packaged cheese wedges of brie, for example and more.